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■ Abstract. We give explicit formulas as well as a quadratic time algorithm to 

solve (so called generalized Vandermonde's) systems of linear equations with p 
equations and n variables. It allows in particular to find all (so called Lagrange's 
interpolation) polynoms with degree n — 1 taking given values in p distinct given 



Q-e points. 
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Introduction 



Vandermonde's linear systems of equations (Alexandre Vandermonde, french Math- 
ematician, 1735-1796) naturally appear in numerical analysis to find Lagrange's in- 
terpolation polynom. When one wants to determine a polynom P(x) with degree 
n — 1 taking given values qi, q 2 , ■ ■ ■ , q n m n distinct points ai, a 2 , ■ ■ ■ , a n , one has to 
solve the (so called Vandermonde's) linear system (*) of equations with unknowns 
w 1 ,w 2 , ...,w n : 

uji + uj 2 a\ + (-o^df H h u n a\~ l = qi 

u>x + oo 2 a 2 + u 3 al H h ^a^" 1 = q 2 



{ uj x + u 2 a n + u 3 al H h w n a" 1 = q n 



It admits a unique solution and the (so called Lagrange's interpolation) polynom 
P(x) of couples {(a±, qi), (a 2 , q 2 ), . . . , (a n , q n )} is given by the formula : 
G\ ■ n 

£2; P(x) = Y,"kX k - 1 

O k=i 

Vandermonde's linear systems also appear naturally in several problems of linear 
^ ! algebra. 

The aim of this work is to give explicit solution to the more general interpolation 
problem consisting in finding all polynoms of degree n — 1 with given values in p 
distinct points, where p may be different from n. It brings us to any system of 
p equations as above with n unknowns, that we shall extensively call generalized 
Vandermonde's linear systems. 
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On the one hand we provide in §1 explicit formulas solving the problem in full 
generality, and on the other we build in §2 a quadratic time algorithm implementing 
the solution. 

1. Explicit solutions to generalized Vandermonde's linear system 

We first consider in §1.1 preliminaries notions necessary for effective computa- 
tions. In §1.2 we establish explicit formulas for the inverse of a Vandermonde's 
square matrix, and consequently for the Lagrange's interpolation polynom. The 
two remaining sections are concerned with generalized Vandermonde's system : in 
§1.3 we explicit the kernel of a non square Vandermonde's matrix, and in §1.4 we 
collect all preceding result to give a solution to the general problem. 

1.1. Preliminaries : monomial coefficients. In this section, A stands for a 
unitary commutative ring. Given p distinct elements oi, a 2 , ■ ■ ■ , a p in A, we define 
for any positive integer t the monomial coefficient of codegree t on ai, a 2 , . . . , a p : 
°ai-ap(*) ( or more concisely o~(t) when there is no ambiguity) informally speaking 
as the sum of all products of t-uples on a±, a 2 , ■ ■ ■ , a p without repetition. 

Definition 1. Let a±, a 2 , ■ ■ ■ , a p , bep distinct elements in A. For any positive integer 
t, the monomial coefficient of codegree t on a±, a 2 , . . . ,a p is the element cr ai ... a (t) of 
A (or more concisely a(t) ) defined by : 

<r(0) =1 a 

a{t) = a (t) = T l i< il< -<i t <p a ii a i2 ■■■ak Vt=l,2,...,p 
a(t) = a (t) = A Vt> p 

a\---a v 

For more convenience in transcription of formulas, we also define the related 
notation : 

Definition 2. Under the same hypothesis as above, and given a = with 1 < k < p, 
the a-monomial coefficient of codegree t on a±,a 2 , . . . ,a p , is defined as the monomial 
coefficient of codegree t on ai, . . . , a k , . . . , a p , that is : 



o*{t) = v a it) = 



a\---a v 

l<i\<---<it<p 
i 1 ,...,i t ^k 



■a it 



We now explicit basic properties of monomial coefficients. 
Lemma 1. Under the same hypothesis as above, for any t — 0, 1, . . . ,p, one has : 

a(t) = a a (t) + aa a (t-l) 
Proof. Immediate by definition □ 

We now enonce the fundamental property of monomial coefficients which moti- 
vates them to be introduced : 

Proposition 1. In the polynom ring A[x], one verifies : 

p p oo 

^-^ = ^(-1)^ a (p-Oa^j^-ir* a (p 

i=l i=0 i=0 



I) X 
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Proof. Immediate by induction □ 



One immediately obtains by setting x = a : 

Corollary 1. Under the same hypothesis as above one has for any a = ai, . . . , a p 



X)(-l) < aV(p-i)=0 



i=0 



1.2. Inversion of a square Vandermonde's matrix. Consider the linear system 
(*) as appearing in the introduction. Let ai, ei2, . . . , a n be n elements of a commu- 
tative field. The Vandermonde's square matrix is the matrix n x n defined by : 

/ 1 at aj ■■■ a™' 1 \ 



Vn 



1 02 a 



\ 1 a n al 



-n-l 



-n-1 



One easily verifies that its determinant is given by : 

n 

det(K)= Yl ( ai - aj )^0 

l<j<i<n 

so that the matrix V n is inversible. 

Consider the family of n polynoms defined for all j = 1, 2, 



, n by : 



n 



x - a k 



■J7 CLj — Ok 



E 



i-l 



fc=i ■> n i=l 



Pj{Oi) 



Clearly : 

so that the inverse matrix V~ l of V n is given by : 



1 if % = j 
otherwise 



C2,l C20 



l<j<n 



\ Cn,l Cn,2 



C\ y n \ 
C2,n 



with the defined as above. 



Let us denote by Dj the denominator of Pj(x), it lies in K*, and by Nj(x) the 
numerator of Pj(x), it lies in K[x] and has degree n — 1. It follows from proposition 
□ that : 



JV i ( a; ) = IJ(^-a*) = X)(- 1 ) < " l ^( 



n — z x 



fc=i 



8=1 



D i = ij(ai-a») = E(-l) < - 1 S ,B 



[n — 1) a 



i-l 



k=l 



1=1 
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et done pour tout i,j — 1,2, ... ,n 



a** (n — i) 



'1,3 



,fc-i 



Hence, the system (*) : 



/ 1 ai a\ 
1 a 2 



< _1 \ / wi \ / gi \ 

a a;2 <?2 



\l a n a 2 n ■■■ al l / \ uj n / \ q n ) 
has a unique n-uple solution uj 2 , • • • , w n ), given by, Vz = 1, 2, . . . , n : 

a aj (n — i) qj 



E 



r ELi(- i ) i+ * y,j ("-*)»* 



fc-i 



One can explicit the Lagrange's interpolation polynom with degree n — 1 and 
respective values q±, q 2 , ■ ■ ■ , q n in points ai, a 2 , ■ ■ ■ , a n : 



n n 



(ya\-a n [n-i)q j 



1=1 



X 



j-1 



1.3. Kernel of a Vandermonde's matrix p x n. In this section p and n are 
integers with 1 < p < n and a\, a 2 , ■ ■ ■ , a p are distinct elements in a commutative 
field K. One considers the Vandermonde's matrix with p lines and n columns : 



Vp,n — 



/ 1 ai a? • • • a?" 1 \ 
1 a 2 a, • • • a?" 1 



\ 1 a p al ■ ■ ■ a" 1 / 

\ P p P ' pxn 

The following theorem explicits a basis for the kernel of V^ n . 

Theorem 1. The kernel of V PtH has dimension n — p and admits a basis given by 
the vector V\ together with all its cyclic conjugates v 2 , ■ ■ ■ , v n _ p : 



Vl 



( (-i)Mp) \ 

(-l)V(i) 

-a(l) 
1 







v 2 



\ 

-l)V(z) 

-a(l) 
1 








\ 





-1)Mp) 

-a(l) 
1 
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Proof. One can easily establish that V P)H has maximal rank. Hence, kerV^ n has 
dimension n — p. It follows from corollary 1 that V\ lies in ker V p . n . By multiplying 
equation of corollary 1 by a k , for < k < n — p, one sees that v 2 , i>3, • • • , v n - p also 
lie in ker V p ^ n . Moreover the family of vectors v\, v 2 , ■ ■ ■ , v n - p is clearly free, so that 
they constitue a basis of ker V PtH . □ 

(Note that the kernel of the Vandermonde's matrix with n lines and p columns 
V ntP has obviously dimension 0.) 



1.4. Generalized Vandermonde's system. Collecting all the above : 

Theorem 2. The generalized Vandermonde's linear system with p equations and n 
unknowns : 

( 1 ai aj ■■■ a n {~ x \ ( u! \ / 9i \ 

^2 ^2 



1 a 2 a 2 . 



\ 1 a 



a 2 
p "p 



,n-l 



has solutions space S a codimension p affine sub-space of the n-dimensional K -vector 
space K n : S = u + ker(Vp in ) 7 with u = u> 2 , ■ ■ ■ , uj p , 0, . . . , 0), and 







( 1 


ai 


UJ 2 




1 


a 2 


\u p J 




V 1 


a p 



1.5. Example. Let : 



Vn-l,T 



( 1 a 2 a\ 
1 o 3 a\ 



V 1 



an. a~ 



p-i 
,p-i 











p,p 


\ 9p / 



,n-l 



,n-l 



ker K-i,n = V"ect( 



/ (-1)^(71 - 1) \ 
(-l)'E(i) 
-E(l) 



V i 



) = Vect( 



/ (-1)" 1 a 2 o 3 • • -a n \ 
(-l)'E(i) 

-(a 2 + a 3 H ha„) 



/ 



V i 



) 



/ 



2. Algorithmic computations 

All along the section a non negative integer p as well as p elements oi, a 2 , 
in a unitary commutative ring A are given. 



, a p 
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2.1. Computation of the monomial coefficients. The lemma [T] provides an 
algorithm d la Pascal to compute all monomial coefficients cr(l), cr(2), . . . , a(p) : 

Proposition 2. There is an algorithm with 0(p 2 ) complexity which computes all 
monomial coefficients o~{t), for t — 0, 1, . . . ,p : 

Consider a matrix withp+1 rows andp columns, where initially the left column is 
constitued of 1 and on the top row is followed with zeros. Then fill in the remaining 
elements starting from the top row to the bottom one and from left to right using : 

element(i,j) = elementii — + ai.elementii — 1, j — 1) 

At the end of the process the bottom row consists in <r(0), cr(l), . . . , a(p). 

Example. Given three elements a, b, c, we apply this method : 








1 


2 


3 




1 













1 


a 








0~ab 


1 


a+b 


ab 





0~abc 


1 


a+b+c 


ab+ac+bc 


abc 



Successive computations give : 
cr a (l) = + axl = a 

a ab (l) = a- a (l) + ba a (0) = a + bxl = a + b 
<r«&(2) = <r a (2) +ba a (l) = + bxa = ab 

(JabciX) = Oafc(l) + ca ab (0) = a + b + cxl = a + b + c 
Ca6c(2) = o~ ab (2) + ca ab (l) = ab + c x (a + b) = ab + ac + be 
o"afec(3) = cr a6 (3) +ca ab (2) = + c x ab = abc 

Algorithm. Given the integer p > 1 and p distinct numbers ai, . . . , a p , the 
following algorithm, written in classical algorithmic language, computes all a(t) for 
i = 0,l,...,p: 

const integer p 
const array of number A [p] = [al , a2 , 
array of number S[p+l]=[l,0, 

// First element of an array has index ! 
for i=l to p 

for j=i to 1 step -1 

S[j]=S [j]+A[i-l]*S[j-l] 
// S[p+1] contains E(0), E(l), . . . , S(p). 

Lemma 1 also provides an algorithm to compute all coefficients for all 

a = oi, a 2 , . . . , a p and t — 0, 1, . . . ,p — 1. 

Proposition 3. Once all monomial coefficients cr(0), cr(l), . . . , cr(p) ; as well as a = 
ai are given, one can algorithmically compute the coefficients a a (0), a a (l), . . . ,a a (p— 



1 1 contains p 
, ap] // contains ax, a 2 , ■ ■ ■ , a p 
,0] 
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1) in linear time 0(p), using the inductive formula : 

a a (0) = 1 

cf a (n) = a(n) — aa a {n — 1) 

En particular, using proposition 2, given p distinct elements a±, a 2 , . . . , a p , there is 
an algorithm which returns in quadratic time 0{p 2 ) the sequence cr(l), er(2), . . . , a(p) 
as well as p sequences a ai (I) ,a ai (2) , . . . , a ai (p — 1), for i — 1,2, . . . ,p. 

Example. Given three distinct elements a, b, c, we apply this method : 








1 


2 


3 


a 


1 


a+b+c 


ab+ac+bc 


abc 


cf a 


1 


b+c 


be 





a b 


1 


a+c 


ac 





o c 


1 


a+b 


ab 






Soit : 










<f(l) 


= (7(1) 


- aa a (0) = 


a + b + c — ax 1 = b + c 




a a {2) 


= (7(2) 


- aa a (l) = 


ab + ac + bc — a(b + c) = 


be 


a\l) 


= a(l) 


- ba b (0) = 


a + b + c — b x 1 = a + c 




a\2) 


= a(2) 


-ba\l) = 


ab + ac + bc — b(a + c) = 


ac 


a%l) 


= (7(1) 


- ca c (0) = 


a + b + c — c x 1 = a + b 




a%2) 


= (7(2) 


-ca c (l) = 


ab + ac + bc — c(a + b) = 


ab 



Algorithm. Given the integer p > 1, p numbers a±,a2, ■ . . ,a p and the sequence 
of monomial coefficients cr(0), cr(l), . . . , c(p), the following algorithm written in 
standard algorithmic language returns all a- monomial coefficients cf a {i) for t = 
0, 1, . . . ,p — 1 and a — a±, a 2 , . . . , a p . 

const integer p // contains p 

const array of number A [p] = [al , . . . , ap] / / contains a±, a2, ■ ■ ■ , a p 

const array of number S [p+1] = [sO, si , . . . , sp] // cr(0), cr(l), . . . , a(p) 
array of array of number T[p] [p] 

for i=0 to p-1 

T[i] [0]=1 

for j=l to p-1 

T[i] [j]= S[j]-a*T[i] [j-1] 
\\ T[i] contains a" l (0), ^(1), . . . , ^(p - 1) 
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